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DETAILED ACTION 

Claim Rejections - 35 USC § 103 

1) The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1-1) Claims 1, 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 19, 20, 21, 22 are 

rejected under 35 U.S.C. 103(a) as being unpatentable over Carleton et al (US 

Patent 5781727, issued Jul 1998) in view of Iran (US Patent 6054990, filed Jul 

1996), further in view of Simonoff (US 6351777, filed Apr 23, 1999), further in view 

of Cass (US 5692073, issued Nov 1997). 

In regard to independent claim 1, Carleton teaches a plurality of workstations 

comprising a computer processor, a display (ie., computers linked together 

displaying)(col 1, line 65 - col 2, line 5). Carleton does not expressly teach, but Tran 

teaches a capture device for capturing a digital image of a document (ie., text or 

graphical illustration, camera , electronic notepad; digital )(co 2, lines 59-63; col 7, lines 

46 - 60). 

Carleton teaches a base computer communicating with the plurality of 
workstation (ie., a single computer runs an application and displays on other 
computers)(col 1 , line 65 - col 2, line 5). 

Carleton does not express teach but Tran teaches (a) identify handwritten annotations in 
digital images of document captured at each workstation (ie., handwritten recognition software 
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for entry/display of pen-based computer as an electronic notepad for annotating photographs, 
pictures captured by a camera that is uploaded to a user computer) (col 7, lines 55-65). 

Carleton in view of Tran doesn't expressly teach, but Simonoff teaches (b) 
communicate data ... plurality of workstations (ie., users at dissimilar computers can 
annotate the information presented to all users)(col 1, lines 20-25). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (c) use 
of data ... each workstation (ie., a decoder at client computer that decodes at a user 
location so user can work on his/her own version)(col 4, lines 40-50). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (d) 
displaying ... first and second workstations (ie., first and second users instantiate 
objects on the whiteboard clients, that are relayed to the other clients)(col 7, lines 5-18). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches the one 
or more ... each workstation (ie., at each client computer, the interpreter decoder 
decodes information specifying an operation to be performed at user)(coI 4, lines 44- 
50). 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include digital/graphical electronic files and handwritten 
annotations as taught by Tran, providing the benefit of creating and attaching text or 
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graphical illustrations to a message, file, data set including photographic annotations 
depicting circumstances leading up the photograph/graphical image (Tran, col 2, lines 
59-67), further to include users at dissimilar computers annotating the information 
presented to users, a decoder at client computer that decodes at a user location 
specifying an operation to be performed at user location, where first and second users 
collaboratively annotate objects on the whiteboard as taught by Simonoff, providing the 
benefit of facilitating interchange of information between two or more dissimilar 
computer users, where users can annotate the information presented to all users 
(Simonoff, 1 , lines 20-30) further to include annotations of an image of an image of a 
particular hardcopy instance document as taught by Cass, providing the benefit of using 
formless forms offering a new flexibility when applied in existing paper based user 
interfaces also providing new applications for paper-based user interface (Cass, col 3, 
lines 30-37). 

In regard to independent claim 11, Carleton teaches a plurality of workstations 
comprising a computer processor, a display (ie., computers linked together 
displaying)(col 1 , line 65 - col 2, line 5). Carleton does not expressly teach, but Tran 
teaches a capture device for capturing a digital image of a document at each 
workstation (ie., text or graphical illustration, camera , electronic notepad; digital )(co 2, 
lines 59-63; col 7, lines 46 - 60). 

Carleton teaches a base computer communicating with the plurality of 
workstation (ie., a single computer runs an application and displays on other 
computers)(col 1 , line 65 - col 2, line 5). 
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Carleton does not express teach but Tran teaches identifying . . . workstation (ie., 
handwritten recognition software for entry/display of pen-based computer as an electronic 
notepad for annotating photographs, pictures captured by a camera that is uploaded to a user 
computer) (col 7, lines 55-65). 

Carleton in view of Tran doesn't expressly teach, but Simonoff teaches (c) 
distributing data ... plurality of workstations (ie., users at dissimilar computers can 
annotate the information presented to all users)(col 1 , lines 20-25). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (d) 
using the data ... each workstation (ie., a decoder at client computer that decodes at a 
user location so user can work on his/her own version)(col 4, lines 40-50). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (e) 
displaying ... first and second workstations (ie., first and second users instantiate 
objects on the whiteboard clients, that are relayed to the other clients)(col 7, lines 5-18). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches the one 
or more ... each workstation (ie., at each client computer, the interpreter decoder 
decodes information specifying an operation to be performed at user)(col 4, lines 44- 
50). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches wherein 
the one or more ... annotation's creation and author (ie., user can select shapes to 
annotate the whiteboard/image)(fig 7). 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
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image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include digital/graphical electronic files and handwritten 
annotations as taught by Tran, providing the benefit of creating and attaching text or 
graphical illustrations to a message, file, data set including photographic annotations 
depicting circumstances leading up the photograph/graphical image (Tran, col 2, lines 
59-67), further to include users at dissimilar computers annotating the information 
presented to users, a decoder at client computer that decodes at a user location 
specifying an operation to be performed at user location, an annotation selection where 
first and second users collaboratively annotate objects on the whiteboard as taught by 
Simonoff, providing the benefit of facilitating interchange of information between two or 
more dissimilar computer users, where users can annotate the information presented to 
all users (Simonoff, 1, lines 20-30) further to include annotations of an image of an 
image of a particular hardcopy instance document as taught by Cass, providing the 
benefit of using formless forms offering a new flexibility when applied in existing paper 
based user interfaces also providing new applications for paper-based user interface 
(Cass, col 3, lines 30-37). 

In regard to independent claim 12, Carleton teaches a plurality of workstations 
comprising a computer processor, a display (ie., computers linked together 
disp!aying)(col 1 , line 65 - col 2, line 5). Carleton does not expressly teach, but Tran 
teaches a capture device for capturing a digital image of a document (ie., text or 
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graphical illustration, camera , electronic notepad; digital )(co 2, lines 59-63; col 7, lines 
46 - 60). 

Carleton teaches a base computer communicating with the plurality of 
workstation (ie., a single computer runs an application and displays on other 
computers)(col 1 , line 65 - col 2, line 5). 

Carleton does not express teach but Tran teaches (a) identifying handwritten annotations 
in digital images of document captured at each workstation (ie., handwritten recognition software 
for entry/display of pen-based computer as an electronic notepad for annotating photographs, 
pictures captured by a camera that is uploaded to a user computer) (col 7, lines 55-65). 

Carleton in view of Tran doesn't expressly teach, but Simonoff teaches (b) 
communicating data ... plurality of workstations (ie., users at dissimilar computers can 
annotate the information presented to all users)(col 1 , lines 20-25). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (c) using 
the data representing ... each workstation (ie., a decoder at client computer that 
decodes at a user location so user can work on his/her own version)(col 4,lines 40-50). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (d) 
displaying ... first and second workstations (ie., first and second users instantiate 
objects on the whiteboard clients, that are relayed to the other clients)(col 7, lines 5-18). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches the one 
or more ... each workstation (ie., at each client computer, the interpreter decoder 
decodes information specifying an operation to be performed at user)(col 4, lines 44- 
50). 



Application/Control Number: 09/738,992 Page 8 

Art Unit: 2176 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include digital/graphical electronic files and handwritten 
annotations as taught by Tran, providing the benefit of creating and attaching text or 
graphical illustrations to a message, file, data set including photographic annotations 
depicting circumstances leading up the photograph/graphical image (Tran, col 2, lines 
59-67), further to include users at dissimilar computers annotating the information 
presented to users, a decoder at client computer that decodes at a user location 
specifying an operation to be performed at user location, where first and second users 
collaboratively annotate objects on the whiteboard as taught by Simonoff, providing the 
benefit of facilitating interchange of information between two or more dissimilar 
computer users, where users can annotate the information presented to all users 
(Simonoff, 1 , lines 20-30), further to include annotations of an image of an image of a 
particular hardcopy instance document as taught by Cass, providing the benefit of using 
formless forms offering a new flexibility when applied in existing paper based user 
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interfaces also providing new applications for paper-based user interface (Cass, col 3, 
lines 30-37). 

Regarding claim 2, 13, Carleton in view of Tran does not expressly teach, but 
Simonoff teaches an additional annotation made by the first or second workstations (ie., 
user can add objects to whiteboard displayed; update information)(col 16, lines 25-34; 
col 1 , line 24). It would have been obvious to one or ordinary skill that to update the 
distribution of annotations to the plurality of workstations (ie., col 1 , line 24 teaches 
updating the information presented to all users). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include adding objects to whiteboard 
displays to update information as taught by Simonoff, providing the benefit of facilitating 
collaboration between a plurality of users (Simonoff, Abstract section). 

In regard to dependent claim 3, 14, Carleton does not teach, but Tran teaches 
capture device at least one workstation comprises a camera (ie., digital 
camera)(Abstract). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include a camera as taught by Tran, providing the 
benefit of annotations to graphical messages, files (Tran, col 2, lines 59-65). 

In regard to dependent claim 4, 15, Carleton teaches information representing 
the annotation as a bitmap (ie., annotations need bitmap)(col 10, line 9 -11). 
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Carleton teaches information indicating the location of the annotation in a 
document (ie., annotation logic draws corresponding annotation at the remote computer 
as from the original computer)(col 7, lines 28-38). 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran and Simonoff to include annotations of an 
image of an image of a particular hardcopy instance document as taught by Cass, 
providing the benefit of using formless forms offering a new flexibility when applied in 
existing paper based user interfaces also providing new applications for paper-based 
user interface (Cass, col 3, lines 30-37). 

In regard to dependent claim 5, 16, Carleton in view of Tran does not expressly 
teach, but it would have been obvious with Simonoff s teachings to have annotation 
object ... annotation (ie., the server maintains a list of files and their origination, where 
the files contain annotations/updates from various client users (col 10, lines 35-65; Fig 
6). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include a server that maintains a list of 
files and their origination as taught by Simonoff, providing the benefit of facilitating 
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collaboration between a plurality of users (Simonoff, Abstract section) and distinguishing 
the origin location of annotations. 

In regard to dependent claim 6, 17, Carleton in view of Tran does not teach, 
but it would have been obvious with SimonofTs teachings to have annotation ... 
annotation (ie., the server maintains a list of files and their meta-data associated with 
files that contain annotations)(Fig 6, see column labeled 'uploaded'). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include a server that maintains a list of 
files and their meta-data associated with files that contain annotations as taught by 
Simonoff, providing the benefit of facilitating collaboration between a plurality of users 
(Simonoff, Abstract section). 

In regard to dependent claim 8, Carleton in view of Tran does not expressly 
teach, but Simonoff teaches plurality of workstations ... origin of the annotation (ie., 
individual user selects a drawing color for the annotations)(col 1 1 , lines 44-45). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include individual user to select a 
drawing color as taught by Simonoff, providing the benefit of facilitating collaboration 
between a plurality of users (Simonoff, Abstract section) and distinguishing the origin 
location of annotations. 

In regard to dependent claim 9, Carleton teaches "each workstation is 
operative to identify handwritten annotations" (col 1 , lines 65 - col 2, line 5). 
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In regard to dependent claim 10, Carleton does not specifically teach, but Tran 
teaches "the base computer is operative to identify handwritten annotations" (col 7, lines 
46 - 65). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include a base computer that accepts handwritten input 
as taught by Tran, providing the benefit of attaching graphical illustrations with 
annotations as an option for users. 

In regard to dependent claim 19, Carleton teaches "annotations originating 
from at least two different other workstations"(ie., three mouses, three cursors, three 
arrows)(col 4, lines 60-67). 

In regard to dependent claim 20, Carleton in view of Tran does not expressly 
teach, but Simonoff teaches plurality of workstations ... origin of the annotation (ie., 
individual user selects a drawing color for the annotations)(col 1 1 , lines 44-45). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include individual user to select a 
drawing color as taught by Simonoff, providing the benefit of facilitating collaboration 
between a plurality of users (Simonoff, Abstract section) and distinguishing the origin 
location of annotations. 

Regarding claim 21, 22, Simonoff teaches one or more of ... author (ie., 
whiteboard server maintains the specific client origination of the upload ... identity of 
user)(ie., col 10, lines 35-44). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include whiteboard server that maintains 
the specific client origination of the upload, including identity of user as taught by 
Simonoff, providing the benefit of facilitating collaboration between a plurality of users 
(Simonoff, Abstract section) and distinguishing the origin location of annotations. 
1-2) Claims 7, 18 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Carleton (as cited above) in view of Tran (as cited above) and Simonoff (as 
cited above), further in view of Levine et al (US Patent 5680636, issued Oct 1997), 
further in view of Cass (as cited above). 

In regard to dependent claim 7, 18, Carleton in view of Tran does not teach, 
but Levine teaches information representing the identity of the document with which the 
annotation is associated (ie., files per annotation are catalogued in a table of contents 
file referred to as a superfile... associated with a particular document)(col 7, lines 1-7). 

Carleton in view of Tran, Simonoff and Levine does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify Carleton in view of Tran and Simonoff to include a catalog of 
annotations as taught by Levine, providing the benefit of having a friendlier computer 
device (col 1 , lines 50-55) and a means to access the documents that contain 
annotations further to include annotations of an image of an image of a particular 
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hardcopy instance document as taught by Cass, providing the benefit of using formless 
forms offering a new flexibility when applied in existing paper based user interfaces also 
providing new applications for paper-based user interface (Cass, col 3, lines 30-37). 

Response to Arguments 
Applicant's arguments with respect to claims 1-22 have been considered but are 
moot in view of the new ground(s) of rejection. Applicant primarily argues that the 
references in combination fail to teach the newly added amendment that the 
handwritten annotations made to a hardcopy document by identifying the annotations in 
a captured image. Examiner disagrees with the rejection using the Cass reference. 
Specifically, Cass teaches an image of a particular hardcopy instance of a document 
and on which instance the user has made a mark (annotation) with a pen, ... (Cass, 
page 8, lines 12-19). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gautam Sain whose telephone number is 571-272- 
4096. The examiner can normally be reached on M-F 9-5 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Feild can be reached on 571-272-4090. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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